Head mounted display and method of controlling therefor

ABSTRACT

The present specification relates to a head mounted display (HMD) and a method of controlling therefor, and more particularly, to a method of updating information displayed in the HMD by recognizing opening and closing of eyes of a user wearing the HMD.

This application claims the benefit of the Korean Patent Application No.10-2013-0102326, filed on Aug. 28, 2013, which is hereby incorporated byreference as if fully set forth herein.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present specification relates to a head mounted display (HMD) and amethod of controlling therefor, and more particularly, to a method ofupdating information displayed in the HMD by recognizing opening andclosing of eyes of a user wearing the HMD.

2. Discussion of the Related Art

Generally, a head mounted display indicates various digital devicesenabling a user to receive a multimedia content in a manner of beingmounted on the head of the user like glasses. According to a trend oflightening and miniaturizing of a digital device, various wearablecomputers have been developed so far and the HMD is also widely used.The HMD can provide various conveniences as well as a simple displayfunction to a user in a manner of being combined with an augmentedreality technology and an N screen technology.

In case of occurring such update information as a short message service(SMS), a user wearing an HMD can recognize the update information viathe HMD without checking such a mobile device as a smartphone. Forinstance, in case of occurring such an event as a time change, a weatherchange, a date change, a telephone reception, and the like, the HMD canrecognize the occurrence of the event in a state that a user wears theHMD.

SUMMARY OF THE INVENTION

Accordingly, the present specification is directed to an apparatus andmethod thereof that substantially obviate one or more problems due tolimitations and disadvantages of the related art.

According to one embodiment, an HMD intends to provide various updatesaccording to a type of object displayed in a display unit.

According to a different embodiment, an HMD intends to provide an updateof an object displayed in a display unit according to a state ofeyes-opened/eyes-closed of a user wearing the HMD.

According to a different embodiment, an HMD intends to provide eachupdate of objects according to a state of eyes-opened/eyes-closed of auser wearing the HMD and a type of object displayed in a display unit,respectively.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein,according to one embodiment, a head mounted display (HMD) includes adisplay unit configured to display an image, a camera unit configured torecognize opening/closing of eyes of a user wearing the HMD, acommunication unit configured to transmit/receive data, and a processorconfigured to control the display unit, the camera unit, and thecommunication unit, wherein the processor is further configured todetect generation of an event, determine whether the event correspondsto a first update information, recognize a condition to update a firstobject corresponding to the first update information when the eventcorresponds to the first update information, wherein the conditioncomprises a first condition that the user closes the eyes and a secondcondition that the user opens the eyes, and, update the first objectcorresponding to the first update information when the recognizedcondition corresponds to the first condition.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein,according to a different embodiment, a method of controlling a headmounted display (HMD) includes the steps of detecting generation of anevent, determining whether the event corresponds to a first updateinformation, recognizing a condition to update a first objectcorresponding to the first update information when the event correspondsto the first update information, wherein the condition comprises a firstcondition that the user closes the eyes and a second condition that theuser opens the eyes, and updating the first object corresponding to thefirst update information when the recognized condition corresponds tothe first condition.

According to one embodiment, an HMD can reduce a sense of fatigue ofeyes resulted from updating an object in a state of eyes-opened of auser by updating such a frequently updated object as time, weather, andthe like in a state of eyes-closed of the user.

According to a different embodiment, an HMD can easily recognize anevent to be recognized by a user in a state of eyes-opened of the userby updating such an object as a message reception, an alarm reception,and the like in the state of eyes-opened of the user.

According to a different embodiment, since an update of an object in anHMD occurs after a predetermined time elapses after an event occurs in acondition of opening/closing eyes of a user, an HMD can handle animmediate change of a state of eyes-opened of the user.

More detail advantageous effect of the invention shall be described indetail in the following description.

It is to be understood that both the foregoing general description andthe following detailed description of the present specification areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this application, illustrate embodiment(s) of the invention andtogether with the description serve to explain the principle of theinvention. In the drawings:

FIG. 1 is a block diagram of a head mounted display (HMD) according tothe present specification;

FIG. 2 is a diagram of an eye condition of a user wearing a head mounteddisplay (HMD) according to the present specification;

FIG. 3 is a diagram for a first embodiment of a method of controlling ahead mounted display (HMD) according to the present specification;

FIG. 4 is a diagram for a second embodiment of a method of controlling ahead mounted display (HMD) according to the present specification;

FIG. 5 is a diagram for a third embodiment of a method of controlling ahead mounted display (HMD) according to the present specification;

FIG. 6 is a diagram for a fourth embodiment of a method of controlling ahead mounted display (HMD) according to the present specification;

FIG. 7 is a diagram for a fifth embodiment of a method of controlling ahead mounted display (HMD) according to the present specification;

FIG. 8 a and FIG. 8 b is a diagram for a sixth embodiment of a method ofcontrolling a head mounted display (HMD) according to the presentspecification;

FIG. 9 a and FIG. 9 b is a diagram for a seventh embodiment of a methodof controlling a head mounted display (HMD) according to the presentspecification;

FIG. 10 a and FIG. 10 b indicates a flowchart of a method of controllinga head mounted display (HMD) according to the present specification.

DETAILED DESCRIPTION OF THE INVENTION

Although terminologies used in the present specification are selectedfrom general terminologies used currently and widely in consideration offunctions, they may be changed in accordance with intentions oftechnicians engaged in the corresponding fields, customs, advents of newtechnologies and the like. Occasionally, some terminologies may bearbitrarily selected by the applicant(s). In this case, the meanings ofthe arbitrarily selected terminologies shall be described in thecorresponding part of the detailed description of the specification.Therefore, terminologies used in the present specification need to beconstrued based on the substantial meanings of the correspondingterminologies and the overall matters disclosed in the presentspecification rather than construed as simple names of theterminologies.

Moreover, while the embodiments have been concretely described withreference to the attached diagrams and the contents written on thediagrams, the present specification may be non-restricted or non-limitedto the embodiments.

FIG. 1 is a block diagram of a head mounted display (HMD) according tothe present specification. Yet, FIG. 1 is just one embodiment and a partof configuring module can be deleted or a new configuring module can beadded according to the necessity of those skilled in the art.

As depicted in FIG. 1, an HMD 100 can include a display unit 110, acamera unit 120, a communication unit 130, and a processor 140.

The display unit 110 can output an image in a display screen. And, thedisplay unit 110 can output an image based on content executed by theprocessor 140 or a control command of the processor 140.

Meanwhile, in the present specification, the HMD 100 can output an imagein the display screen in various modes. In one embodiment, the HMD 100can output an image in a see-through mode. In this case, the see-throughmode indicates that the display screen is transparent. The see-throughmode indicates a mode capable of using content while a user wearing theHMD 100 is recognizing the surrounding environment. In anotherembodiment, the HMD 100 can output an image in a front-light mode. Inthis case, the front-light mode indicates a mode capable of displayingan image to which a light is reflected without directly projecting toeyes via such a reflector as a mirror.

And, in another embodiment, the HMD 100 can output an image in asee-closed mode. In this case, the see-closed mode indicates a mode notcapable of seeing an external environment via the display screen andcapable of using contents via the display screen. The presentspecification is explained under an assumption that the HMD 100 displaysan image in the see-through mode or the front-light mode.

The camera unit 120 can take a picture of an image. More specifically,the camera unit 120 can take a picture of an image of a front direction.In this case, the front direction may indicate a direction at which thecamera unit 120 faces. And, the camera unit 120 senses an image withinan angle of view area and can provide the image to the processor 140. Inthis case, the angle of view area indicates a range of a horizontal andvertical viewing angle capable of being included in a prescribed screenin case of sensing an image.

In the present specification, the camera unit 120 can be positioned atan outside or an inside of the HMD 100. In case that the camera unit 120is positioned at the outside of the HMD 100, the camera unit 120 cansense an image of a front direction of the HMD 100. And, in case thatthe camera unit 120 is positioned at the inside of the HMD 100, thecamera unit 120 can sense opening and closing of eyes of a user.

The communication unit 130 performs a communication with an externaldevice using various protocols and can transceive a data with theexternal device using the various protocols. And, the communication unit130 can transceive such a digital data as content and the like byaccessing a network in wired or wireless. For instance, thecommunication unit 130 can use such a communication standard as WLAN(Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (WorldInteroperability for Microwave Access), HSDPA (High Speed DownlinkPacket Access), and the like to access a wireless network.

In the present specification, the communication unit 130 cantransmit/receive a data. More specifically, the communication unit 130can receive an event occurrence for the HMD 100. For instance, anoccurred event may include a time change, a date change, a weatherchange, e-mail reception, an SNS (social network service) update, SMSreception, and the like.

The processor 140 processes a data, controls each of the units of theaforementioned mobile device 100, and can control datatransmission/reception between units.

In the present specification, the processor 140 can detect an eventgeneration. And, the processor 140 can determine whether an eventcorresponds to first update information. If the event corresponds to thefirst update information, the processor 140 can recognize a condition toupdate a first object corresponding to the first update information.And, if a recognized condition corresponds to a first condition, theprocessor 140 can update the first object corresponding to the firstupdate information. Regarding this, it shall be described in detail inFIG. 3 to FIG. 9.

As an embodiment of the present specification, operations performed bythe HMD 100 can be controlled by the processor 140. For clarity, in thefollowing description and diagrams, these operations are commonlydepicted and explained in a manner that the HMD 100 performs/controlsthe operations.

Meanwhile, although it is not depicted in FIG. 1, the HMD 100 caninclude a sensor unit, a power unit, a storage unit, and the like. Thesensor unit senses a surrounding environment of the device using atleast one sensor installed in the HMD 100 and can deliver a sensedresult to the processor 140 in a signal form.

The power unit is a power source connected to an internal battery or anexternal power supply of the HMD 100. The power unit can supply power tothe HMD 100. And, the storage unit can store such various digital dataas an audio, a picture, a video, an application, and the like. Thestorage unit may indicate such various digital data storage spaces as aflash memory, RAM (random access memory), SSD (solid state drive), andthe like.

The HMD 100 depicted in FIG. 1 is a block diagram according to oneembodiment. Blocks represented in a manner of being separated indicatethe logically distinguished elements of the HMD 100. Hence, the elementsof the aforementioned HMD 100 can be equipped with a single chip or aplurality of chips according to the design of the device.

FIG. 2 is a diagram of an eye condition of a user wearing a head mounteddisplay (HMD) according to the present specification. More specifically,FIG. 2 (a) indicates a case that a user wearing the HMD 100 is in astate of eyes-opened and FIG. 2 (b) indicates a case that the userwearing the HMD 100 is in a state of eyes-closed.

The HMD 100 can perform a related function in a manner of recognizingeyes-opened/eyes-closed state of a user via the camera unit installed inthe HMD 100. For instance, the HMD 100 can activate/deactivate thedisplay unit by recognizing the eyes-opened/eyes-closed state of theuser and can execute/does not execute a specific application of the HMD100. The present specification explains that the HMD 100 updates variousobjects according to the state of eyes-opened/eyes-closed of the user.

In one embodiment, as depicted in FIG. 2 (a), the HMD 100 can updatesecond update information for a second object in a state of eyes-openedof the user. In this case, the state of eyes-opened may include a casethat the HMD 100 can recognize a gaze of the user 10 for the displayunit as well as a case that the user 10 sees a front side.

In this case, the second object may correspond to information on anoccurred event needed to be informed to the user 10. For instance, thesecond object can include an e-mail object, an SNS object, an SMSobject, a telephone object, an alarm object, and the like. And, thesecond update information on the second object may correspond toinformation of relatively high importance compared to the informationupdated in a state of eyes-closed. In particular, the update for thesecond object may correspond to a case that the user 10 needs torecognize the update in the state of eyes-opened of the user 10. And,the second update information can occur when an event for the secondobject occurs only.

In another embodiment, in the state of eyes-closed of the user depictedin FIG. 2 (b), the HMD 100 can update first update information for afirst object. In this case, the state of eyes-closed may include a stateof temporarily closing eyes while the user blinks eyes as well as astate of closing eyes for a predetermined time.

In this case, the first object may correspond to an object continuouslydisplayed in the display unit or an object frequently displayed in thedisplay unit. For instance, the first object may include a time object,a weather object, a battery object, and the like. And, since the firstupdate information on the first object is updated in the state ofeyes-closed, the first update information may correspond to theinformation of a relatively low importance compared to the informationupdated in the state of eyes-opened. And, the first update informationcan be periodically generated according to a predetermined timeinterval.

In the following FIG. 3 to FIG. 9, a method of updating updateinformation, which is updated by the HMD 100 mounted on a user, isdescribed according to the state of eyes-opened/eyes-closed of the userand a type of an occurred event.

FIG. 3 is a diagram for a first embodiment of a method of controlling ahead mounted display (HMD) according to the present specification. Morespecifically, FIG. 3 indicates a case that first update information isupdated in the state of eyes-closed of a user 10.

As depicted in FIG. 3, the HMD 100 can detect a generation of an event.In this case, the HMD 100 may be in a state of being worn by the user10. In this case, the event may correspond to information occurred toupdate an object displayed in the display unit 110 or an object to bedisplayed in the display unit. For instance, the generated event mayinclude a time change, a weather change, a telephone reception, amessage reception, an alarm reception, and the like. In the FIG. 3, thegenerated event corresponds to the time change, i.e., ‘one minuteelapse’.

And, the HMD 100 can determine whether the generated event is the firstupdate information. As mentioned earlier in FIG. 2, the first updateinformation is information configured to update the first object and maycorrespond to the information of a relatively low importance compared tothe information updated in the state of eyes-opened. For instance, thefirst update information may include weather update information, timeupdate information, battery update information, and the like. In FIG. 3,the generated event is a change of time from ‘8:40 AM’ to ‘8:41 AM’.Hence, the generated event may correspond to the first updateinformation.

Meanwhile, if an event corresponds to the first update information, theHMD 100 can recognize a condition to update a first object 20corresponding to the first update information. In this case, thecondition to update the first object 20 corresponds to eyes 11 status ofa user 10. For instance, the condition to update the first object 20 caninclude a first condition that the user 10 closes the eyes 11 and asecond condition that the user 10 opens the eyes 11. And, the firstobject may correspond to a target object to update the first updateinformation. For instance, the first object may include a time object, aweather object, a battery object, and the like. Referring to FIG. 3,when the first update information occurs, the HMD 100 can recognize itas the first condition that the user 10 closes the eyes 11.

And, if a recognized condition corresponds to the first condition, theHMD 100 can update the first object 20 corresponding to the first updateinformation. And, the HMD 100 can display the updated first object 20 inthe display unit 110. Referring to FIG. 3, since the eyes 11 of the user10 correspond to the first condition when one minute elapses, the HMD100 can update the time object, which is the first object, from ‘8:40AM’ to ‘8:41 AM’. And, referring to FIG. 3, the HMD 100 can display‘8:41 AM’, which is an updated state of the first object, in the displayunit 110. By doing so, if the user 10 opens the users' eyes later, theuser can recognize the first object updated to ‘8:41 AM’. In particular,according to the present specification, the user 10 does not need to seethat the time is updated on every one minute in the state ofeyes-opened.

As mentioned earlier in the embodiment of FIG. 3, in case of afrequently updated object such as time, the HMD 100 updates the objectin the state of eyes-closed, thereby reducing a sense of fatigue of theeyes of the user 10.

FIG. 4 is a diagram for a second embodiment of a method of controlling ahead mounted display (HMD) according to the present specification. Morespecifically, FIG. 4 indicates a case that the first update informationis updated in the state of eyes-opened of the user 10.

As depicted in FIG. 4, the HMD 100 can detect a generation of an event.Referring to FIG. 4, the generated event may correspond to a timechange. And, the HMD 100 can determine whether the event is first updateinformation. Referring to FIG. 4, the generated event is a change oftime from ‘8:40 AM’ to ‘8:41 AM’. Hence, the generated event maycorrespond to the first update information.

And, if an event corresponds to the first update information, the HMD100 can recognize a condition to update a first object 20 correspondingto the first update information. Referring to FIG. 4, when the firstupdate information occurs, the HMD 100 can recognize it as a secondcondition that the user 10 opens the eyes 11.

Hence, if a recognized condition corresponds to the second condition,the HMD 100 can stop updating the first object 20 corresponding to thefirst update information until the recognized condition is switched fromthe second condition to the first condition. More specifically, if theuser is in the state of eyes-opened when the first update informationoccurs, the HMD 100 can stop updating the first object corresponding tothe first update information until the user 10 is switched to the stateof eyes-closed.

Referring to FIG. 4, when one minute elapsed, since the eyes 11 of theuser 10 is in the state of eyes-opened, the HMD 100 does not perform anupdate of the first object 20. This is because if the user 10 recognizesthe time change on every minute in the state of eyes-opened, it may givea sense of fatigue and confusion to the eyes of the user. Hence, the HMD100 updates the time object of the display unit 100 to ‘8:41 AM’ whenthe state of eyes-opened of the user 10 is shifted to the state ofeyes-closed of the user 10 and can display ‘8:41 AM’ in the display unit110.

Referring to the embodiment of FIG. 4, in case of a frequently updatedobject such as time, although an update occurs, the HMD 100 does notupdate in the state of eyes-opened. Instead, the HMD updates in thestate of eyes-opened, thereby reducing a sense of fatigue of the eyes ofthe user 10.

Meanwhile, unlike the aforementioned in FIG. 4, if recognized conditioncorresponds to a second condition and the recognized condition is notswitched to the first condition until a predetermined time elapses, theHMD 100 can update the first object corresponding to the first updateinformation. In particular, if the user does not close the user's eyesuntil the time ‘8:40 AM’ reaches to ‘8:42 AM’ in a manner of elapsing‘8:41 AM’, the HMD 100 can update the first object to ‘8:42 AM’. This isbecause if the state of eyes-opened of the user 10 is maintained for along time, since the first update information, which is supposed to beupdated, may be accumulated, the user 10 may be confused on the timelater.

FIG. 5 is a diagram for a third embodiment of a method of controlling ahead mounted display (HMD) according to the present specification. Morespecifically, FIG. 5 indicates a case that second update information isupdated in the state of eyes-opened of the user 10.

As depicted in FIG. 5, the HMD 100 can detect a generation of an event.In FIG. 5, the generated event corresponds to a message reception.

And, the HMD 100 can determine whether the event corresponds to firstupdate information. In FIG. 5, the generated event corresponds to themessage reception and does not correspond to the first updateinformation aforementioned in FIG. 2. In this case, the HMD 100 candetermine whether the event correspond to a second update information.As mentioned earlier in FIG. 2, the second update information isinformation to update a second object and may correspond to theinformation of a relatively high importance compared to the informationupdated in the state of eyes-closed. For instance, the second updateinformation can include an e-mail reception, an SNS reception, an SMSreception, an alarm reception, and the like. In FIG. 5, the generatedevent corresponds to the SMS reception and may correspond to the secondupdate information.

Meanwhile, if the event corresponds to the second update information,the HMD 100 can recognize a condition to update a second object 30corresponding to the second update information. In this case, thecondition to update the second object 30 may indicate eyes 11 status ofthe user 10. For instance, the condition to update the second object mayinclude a first condition that the user 10 closes the user's eyes 11 anda second condition that the user 10 opens the user's eyes 11. In FIG. 5,when the second update information occurs, the HMD 100 can recognize itas the second condition that the user 10 opens the user's eyes 11. And,the second object 30 may correspond to a target object to update thesecond update information. For instance, the second object can includean e-mail object, an SNS object, an SMS object, an alarm object, and thelike.

Meanwhile, unlike the first object, the second object may not always bedisplayed in the display unit 110. In particular, the second object canbe displayed in the display unit 110 when the second update informationoccurs or when the user 10 activates the second object only.

Hence, if a recognized condition corresponds to the second condition,the HMD 100 can update the second object corresponding to the secondupdate information. And, the HMD 100 can display the updated secondobject in the display unit 110. In FIG. 5, since the eyes of the usercorrespond to the second condition when an SMS is received, the HMD 100can update an SMS object, which is the second object. And, in FIG. 5,the HMD 100 can display a received SMS message ‘How are you?’ which isan updated state of the second object, in the display unit 110.

Referring to the embodiment of FIG. 5, the HMD 100 can make the user 10easily recognize an event occurrence in a manner of updating not anobject regularly updated but an object updated on a specific event inthe state of eyes-opened of the user 10.

FIG. 6 is a diagram for a fourth embodiment of a method of controlling ahead mounted display (HMD) according to the present specification. Morespecifically, FIG. 6 indicates a case that second update information isupdated in the state of eyes-closed of the user 10.

As depicted in FIG. 6, the HMD 100 can detect a generation of an event.In FIG. 6, the generated event corresponds to an SMS reception.Subsequently, the HMD 100 determines whether the generated event isfirst update information. If the generated event is not the first updateinformation, the HMD determines whether the generated event is secondupdate information. In FIG. 6, the generated event corresponds to the‘SMS reception’ and may correspond to the second update information.

And, if the event corresponds to the second update information, the HMD100 can recognize a condition to update a second object 30 correspondingto the second update information. In FIG. 6, when the second informationoccurs, the HMD 100 can recognize it as a first condition that the user10 closes the user's eyes 11.

In this case, if a recognized condition corresponds to the firstcondition, the HMD 100 can stop updating of the second object 30corresponding to the second update information until the recognizedcondition is switched to the second condition form the first condition.In FIG. 6, since the eyes 11 of the user 10 is in the state ofeyes-closed when the SMS is received, the HMD 100 does not perform theupdate of the second object 30. And, when the eyes of the user is in thestate of eyes-opened, the HMD 100 updates the SMS object and can display‘How are you?’ message in the display unit 110.

Referring to the embodiment of FIG. 6, in case of an event, which issupposed to be recognized by the user 10, the HMD 100 updates the eventin the state of eyes-opened of the user 10, thereby easily recognizingthe occurred event by the user 10.

Meanwhile, unlike the aforementioned in FIG. 6, if the recognizedcondition corresponds to a first condition and the first condition isnot switched to a second condition until a predetermined time elapses,the HMD 100 can update a second object corresponding to second updateinformation. And, the HMD 100 can inform the user 10 of the update ofthe second object via a vibration, a sound and the like in the state ofthe first condition. In particular, if the user 10 do not open theuser's eyes until a predetermined time elapses after ‘How are you?’message is received, the HMD 100 can inform the user of the ‘How areyou?’ message received in the second object by such a means as avibration and a sound. This is because if the state of eyes-closed ofthe user 10 is maintained for a long time, since plurality of the secondupdate information occur, it is intended to inform the user that thesecond update information has arrived by such a means as a vibration anda sound.

FIG. 7 is a diagram for a fifth embodiment of a method of controlling ahead mounted display (HMD) according to the present specification. Morespecifically, FIG. 7 indicates that plurality of second updateinformation is updated in the state of eyes-opened of the user 10. And,the second embodiment indicates a case that plurality of the secondupdate information is generated in a second condition.

In one embodiment, the HMD 100 can update plurality of second updateinformation and display second update information on a first event amongplurality of generated events in the display unit 110. In this case,plurality of the generated second update information may correspond to acase that a sending address of an event is identical to each other. Thisis because if a plurality of messages are sent from an identical person,if a message reception is informed to the user, it is not necessary toshow all of a plurality of the messages to the user 10.

As depicted in FIG. 7, plurality of the second update informationcorresponds to update information on ‘SMS object’, which is a secondobject and can include 4 update information. And, in FIG. 7, pluralityof the second update information has an identical sending address, whichis ‘Tim’. Hence, the HMD 100 updates all of plurality of the secondinformation and displays ‘How are you’, which is the second updateinformation on the first event, in the display unit 110. The remainingsecond update information can be represented by a number only.

In another embodiment, the HMD 100 can update plurality of the secondupdate information and sequentially display plurality of the generatedsecond update information in the display unit 110. In this case,plurality of the generated second update information may have a sendingaddress of an event different from each other. This is because in caseof a plurality of messages sent from a person different from each other,it is necessary to inform the user 10 that each message is received froma person different from each other.

Although it is not depicted in FIG. 7, if plurality of the second updateinformation is detected, the HMD 100 can display plurality of the secondupdate information in the display unit 110 in an order of beingdetected.

FIG. 8 is a diagram for a sixth embodiment of a method of controlling ahead mounted display (HMD) according to the present specification. Morespecifically, FIG. 8 a indicates that first update information isupdated in the state of eyes-closed of the user 10 and FIG. 8 bindicates that the first update information is updated in the state ofeyes-opened of the user 10. Yet, FIG. 8 a and FIG. 8 b indicates a casethat the first update information is generated and then the first objectis updated after a first time (T1) elapsed.

First of all, referring to FIG. 8 a, the HMD 100 can recognize that theuser 10 sees a first object 20 displayed in the display unit 110 in thestate of eyes-opened on a timing point A. And, a time object displayedin the display unit 110 on the timing point A corresponds to ‘8:40 AM’.

Meanwhile, the HMD 100 can detect an event on a timing point B. In thiscase, the event corresponds to a change of time from ‘8:40 AM’ to ‘8:41AM’ and may correspond to the first update information.

And, the HMD 100 can recognize the state of eyes-closed of the user 10as a condition to update the first object 20 corresponding to the firstupdate information on the timing point B. And, if the HMD 100 recognizesthe state of eyes-closed of the user 10 on a timing point C of which afirst time (T1) elapses from the timing point B, the first updateinformation can be updated in the first object 20. In this case, thefirst time (T1) corresponds to a predetermined time and indicates a timetaken from an occurrence of the first update information to a practicalupdate of the first update information.

In this case, when the first condition to update the first object 20corresponding to the first update information after an event hasoccurred, the HMD 100 may not directly update the first object 20. Inparticular, the HMD 100 can update the first object 20 after the firsttime (T1) elapses from the occurrence of the event in the firstcondition. This is because if the first condition is changed to thesecond condition, which is the state of eyes-opened, before the firsttime (T1) elapses from the occurrence of the update information, it isnot necessary to update the first object.

Subsequently, referring to FIG. 8 b, since the timing point A and thetiming point B are identical to those of FIG. 8 a, explanation on thetiming point A and the timing point B is omitted. The HMD 100 canrecognize a second condition, which corresponds to the state ofeyes-opened of the user 10, on the timing point C of which the firsttime (T1) elapses from the timing point B. In this case, unlike theaforementioned in FIG. 8 a, the HMD 100 does not update the first updateinformation in the first object 20 on the timing point of C.

In particular, the HMD 100 can update the first update information inthe first object on a timing point D, which is a timing point that theeyes of the user correspond to the first condition again. This isbecause if the first object 20 is updated in the second condition, itmay give a sense of fatigue to the eyes 11 of the user 10. Hence, thefirst object 20 is updated when the eyes of the user correspond to thefirst condition again.

FIG. 9 is a diagram for a seventh embodiment of a method of controllinga head mounted display (HMD) according to the present specification.More specifically, FIG. 9 a indicates that the second update informationis updated in the state of eyes-opened of the user 10 and FIG. 9 bindicates that the second update information is updated in the state ofeyes-closed of the user 10. Yet, FIG. 9 a and FIG. 9 b indicates a casethat the second update information is generated and then the secondobject is updated after a second time (T2) elapsed.

First of all, referring to FIG. 9 a, the HMD 100 can recognize that theuser 10 sees the first object 20 displayed in the display unit 110 inthe state of eyes-opened of the user 10 on the timing point A. In thiscase, the first object 20 can always be displayed in the display unit110 irrespective of an occurrence of an event. On the contrary, thesecond object 30 can be displayed in the display unit 110 when an eventoccurs only.

Meanwhile, the HMD 100 can detect an event on the timing point of B. Inthis case, the event may correspond to an SMS reception. If the event isnot the first update information, the HMD 100 can determine whether theevent corresponds to the second update information. In FIG. 9 a, themessage reception event corresponds to the second update information.And, the HMD 100 can recognize the state of eyes-opened of the user 10as a condition to update the second update information on the timingpoint of B. If the state of eyes-opened of the user 10 is recognized onthe timing point of C of which the second time (T2) elapses from thetiming point B, the HMD 100 can update the second update information inthe second object 30. In this case, the second time (T2) corresponds toa predetermined time and indicates a time taken from an occurrence ofthe second update information to a practical update of the second updateinformation. And, since it is necessary for the second time (T2) toimmediately inform the user of an event occurrence, the second time maycorrespond to a short time less than 0.1 second.

In this case, when the second condition to update the second object 30corresponding to the second update information after an event hasoccurred, the HMD 100 may not directly update the second object 30 onthe timing point of B. In particular, the HMD 100 can update the secondobject 30 after the second time (T2) elapses from the occurrence of theevent in the second condition. This is because if the second conditionis changed to the first condition, which is the state of eyes-closed,before the second time (T2) elapses from the occurrence of the updateinformation in the second condition, it is not necessary to update thesecond object.

Subsequently, referring to FIG. 9 b, since the timing point A and thetiming point B are identical to those of FIG. 9 a, explanation on thetiming point A and the timing point B is omitted. The HMD 100 canrecognize a first condition, which corresponds to the state ofeyes-closed of the user 10, on the timing point C of which the secondtime (T2) elapses from the timing point B. In this case, unlike theaforementioned in FIG. 9 a, the HMD 100 does not update the secondupdate information in the second object 20 on the timing point of C.

In particular, the HMD 100 can update the second update information inthe second object 30 on a timing point D, which is a timing point thatthe eyes 11 of the user 10 correspond to the second condition again.This is because if the second object 30 is updated in the firstcondition, it may not recognize an event although the event, which issupposed to be recognized by the user 10, has occurred.

FIG. 10 indicates a flowchart of a method of controlling a head mounteddisplay (HMD) according to the present specification. Each step of FIG.10 a and FIG. 10 b explained in the following description can becontrolled by the processor 140 of the HMD 140 depicted in FIG. 1.

First of all, the HMD 140 can detect a generation of an event [S1010].As mentioned earlier in FIG. 3, the event may correspond to informationoccurred to update an object displayed or to be displayed in the displayunit 110. For instance, the generated event may include a time change, aweather change, a telephone reception, a message reception, and thelike.

Subsequently, the HMD can determine whether the generated eventcorresponds to first update information [S1020]. As mentioned earlier inFIG. 3, the first update information may correspond to information toupdate a first object. For instance, the first update information mayinclude a weather update, a time update, a battery update, and the like.

In the step S1020, if the generated event corresponds to the firstupdate information, the HMD can recognize a condition to update thefirst object corresponding to the first update information [S1030]. Inthis case, the condition to update the first object corresponds to aneyes status of the user. For instance, the condition to update the firstobject may include a first condition that the user closes the user'seyes and a second condition that the user opens the user's eyes.

Subsequently, the HMD can determine whether a recognized conditioncorresponds to the first condition or the second condition [S1040]. TheHMD can recognize/determine a state of eyes-opened and a state ofeyes-closed of the user by a camera installed in the HMD.

In the step S1040, if the recognized condition corresponds to the firstcondition, the HMD can update the first object corresponding to thefirst update information [S1050]. In particular, as mentioned earlier inFIG. 3, the HMD can update the first object such as the time object inthe state of eyes-closed of the user. And, the HMD displays the updatedfirst object in the display unit and makes the user recognize theupdated first object in the state of eyes-opened of the user.

In the step S1040, if the recognized condition corresponds to the secondcondition, the HMD can stop updating the first object corresponding tothe first update information until the recognized condition is switchedto the first condition from the second condition [S1060]. In particular,as mentioned earlier in FIG. 4, the HMD stops updating of the firstobject in the state of eyes-opened of the user and can update the firstobject in a next first condition.

Meanwhile, in the step S1020, if the generated event does not correspondto the first update information, the HMD can determine whether thegenerated event corresponds to second update information [S1070]. Asmentioned earlier in FIG. 5, the second update information maycorrespond to information to update a second object. For instance, thesecond update information can include an e-mail reception, an SMSreception, an SNS update, and the like.

In the step S1070, if the generated event corresponds to the secondupdate information, the HMD can recognize a condition to update thesecond object corresponding to the second update information [S1080].Subsequently, the HMD can determine whether the recognized conditioncorresponds to a first condition or a second condition [S1090].

In the step S1090, if the recognized condition corresponds to the firstcondition, the HMD can stop updating the second object corresponding tothe second update information until the recognized condition is switchedto the second condition from the first condition [S1100]. In particular,as mentioned earlier in FIG. 6, the HMD can stop updating the secondobject in the state of eyes-closed of the user and can update the secondobject in a next second condition.

In the step of S1090, if the recognized condition corresponds to thesecond condition, the HMD can update the second object corresponding tothe second update information [S1110]. In particular, as mentionedearlier in FIG. 5, the HMD can update the second object such as the SMSobject in the state of eyes-opened of the user. And, the HMD displaysthe updated second object in the display unit and makes the userrecognize that the second object is updated.

For clarity of explanation, each diagram is explained in a manner ofbeing divided. Yet, it is possible to design a new embodiment toimplement the new embodiment by combining the embodiments, which aredescribed in each of the diagrams. And, according to the necessity ofthose skilled in the art, designing a recording media readable by thecomputer, which has recorded a program for executing the previouslyexplained embodiments, also belongs to a scope of a right.

A head mounted display and a method of controlling therefor according tothe present specification may not limitedly apply to the composition andmethod of the aforementioned embodiments. The aforementioned embodimentsmay be configured in a manner of being selectively combined the whole ofthe embodiments or a part of the embodiments to achieve variousmodifications.

Meanwhile, a head mounted display according to the present specificationand a method of controlling therefor can be implemented with a codereadable by a processor in a recording media readable by the processor,which is equipped in a network device. The recording media readable bythe processor may include all kinds of recording devices for storingdata capable of being read by the processor. The examples of therecording media readable by the processor may include a ROM, a RAM, amagnetic tape, a floppy disc, an optical data storing device and thelike. And, to implement in a form of a carrier wave such as atransmission via the internet and the like is also included. And, sincethe recording media readable by the processor are distributed to thecomputers connected by a network, codes readable by the processor can bestored and executed in a manner of being distributed.

While the present specification has been described and illustratedherein with reference to the preferred embodiments and diagrams thereof,the present specification may be non-limited to the aforementionedembodiments and it will be apparent to those skilled in the art thatvarious modifications and variations can be made therein withoutdeparting from the spirit and scope of the present specification. Thus,it is intended that the present specification covers the modificationsand variations of this invention that come within the scope of theappended claims and their equivalents.

And, both an apparatus invention and a method invention are explained inthe present specification and the explanation on the both of theinventions can be complementally applied, if necessary.

What is claimed is:
 1. A head mounted display (HMD), comprising: adisplay unit configured to display an image; a camera unit configured torecognize opening/closing of eyes of a user wearing the HMD; acommunication unit configured to transmit/receive data; and a processorconfigured to control the display unit, the camera unit, and thecommunication unit, the processor is further configured to: detectgeneration of an event, determine whether the event corresponds to afirst update information or a second update information, recognize acondition to update a first object corresponding to the first updateinformation when the event corresponds to the first update informationor to update a second object corresponding to the second updateinformation when the event corresponds to the second update information,wherein the first update information is updated in a first conditionthat the user closes the eyes and the second update information isupdated in a second condition that the user opens the eyes, the firstupdate information and the second update information being different,update the first object corresponding to the first update information inthe first condition, and update the second object corresponding to thesecond update information in the second condition.
 2. The head mounteddisplay of claim 1, wherein if the recognized condition corresponds tothe second condition, the processor is further configured to stopupdating of the first object corresponding to the first updateinformation until the recognized condition is switched to the firstcondition from the second condition.
 3. The head mounted display ofclaim 2, wherein the processor is further configured to update the firstobject corresponding to the first update information when the recognizedcondition corresponds to the second condition and is not switched to thefirst condition until a third time elapses.
 4. The head mounted displayof claim 1, wherein if the recognized condition corresponds to the firstcondition, the processor is further configured to stop updating of thesecond object corresponding to the second update information until therecognized condition is switched to the second condition from the firstcondition.
 5. The head mounted display of claim 4, wherein the firstobject and the second object are classified according to an order ofimportance of the generated event.
 6. The head mounted display of claim5, wherein the first object comprises time, weather, and a battery andthe second object comprises an alarm, a mail, and a message.
 7. The headmounted display of claim 5, wherein the first update informationcorresponds to information periodically generated according to apredetermined time interval and the second update informationcorresponds to information generated when an event for the second objectoccurs.
 8. The head mounted display of claim 4, wherein the processor isfurther configured to update the second object corresponding to thesecond update information when the recognized condition corresponds tothe first condition and is not switched to the second condition until afourth time elapses.
 9. The head mounted display of claim 1, wherein theprocessor is further configured to display an updated first object whenthe event corresponds to the first update information and the recognizedcondition corresponds to the first condition, and display an updatedsecond object when the event corresponds to the second updateinformation and the recognized condition corresponds to the secondcondition.
 10. The head mounted display of claim 1, wherein theprocessor is further configured to update a plurality of the secondupdate information in the second object and display second updateinformation on a first event among a plurality of generated events inthe second object when generation of a plurality of second updateinformation is detected continuously and the recognized conditioncorresponds to the second condition.
 11. The head mounted display ofclaim 10, wherein the plurality of the generated second updateinformation comprise a sending address of the event identical to eachother.
 12. The head mounted display of claim 1, wherein the processor isfurther configured to update plurality of the second update informationin the second object and sequentially display a plurality of updatedsecond objects when generation of a plurality of second updateinformation is detected continuously and the recognized conditioncorresponds to the second condition.
 13. The head mounted display ofclaim 12, wherein a plurality of the generated second update informationcomprise a sending address of the event different from each other. 14.The head mounted display of claim 1, wherein updating the first objectcorresponding to the first update information is updating the firstobject after when the first update information is generated and a firsttime has elapsed at the first condition.
 15. The head mounted display ofclaim 14, wherein the processor is further configured to update thefirst object corresponding to the first update information in aproceeding first condition of the first condition when after the firsttime at the first condition corresponds to the second condition.
 16. Thehead mounted display of claim 1, wherein updating the second objectcorresponding to the second update information is updating the secondobject after when the second update information is generated and asecond time has elapsed at the second condition.
 17. The head mounteddisplay of claim 16, wherein the processor is further configured toupdate the second object corresponding to the second update informationin a proceeding second condition of the second condition when after thesecond time at the second condition corresponds to the first condition.18. The head mounted display of claim 1, wherein the first conditioncomprises a blink of the user.
 19. A method of controlling a headmounted display (HMD), the method comprising: detecting generation of anevent; determining whether the event corresponds to a first updateinformation or a second update information; recognizing a condition toupdate a first object corresponding to the first update information whenthe event corresponds to the first update information or to update asecond object corresponding to the second update information when theevent corresponds to the second update information, wherein the firstupdate information is updated in a first condition that the user closesthe eyes and the second update information is updated in a secondcondition that the user opens the eyes, the first update information andthe second update information being different; updating the first objectcorresponding to the first update information in the first condition;and updating the second object corresponding to the second updateinformation in the second condition.